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The Shannon entropy of a collection of random variables is subject to a number of constraints, the best-known 
examples being monotonicity and strong subadditivity. It remains an open question to decide which of these 
"laws of information theory" are also respected by the von Neumann entropy of many-body quantum states. In 
this note, we consider a toy version of this difficult problem by analyzing the von Neumann entropy of stabilizer 
states. We find that the von Neumann entropy of stabilizer states satisfies all balanced information inequalities 
that hold in the classical case. Our argument relies on the fact that any stabilizer state has a classical model, 
provided by the discrete Wigner function: The phase-space entropy of the Wigner function corresponds directly 
to the von Neumann entropy of the state, which allows us to reduce to the classical case. Our result has a 
natural counterpart for multi-mode Gaussian states, which sheds some light on the general properties of the 
construction. 



Remark: After the research presented in this note had been 
concluded. Linden, Ruskai, and Winter published a preprint 
which also presents an analysis of the entropy cone gener- 
ated by stabilizer states Ol. While our main result is implied 
by fUl, we believe that our approach of providing a classical 
model via phase space distributions is of independent interest. 



I. INTRODUCTION AND RESULTS 

The Shannon entropy of a discrete random variable X is 
given by H{X) = — J2xPx^'^SPx, where px is the proba- 
bility that X X. Given a collection of random variables 
Xi, . . . , Xn, we can consider the joint entropy H{Xj) of any 
non-empty subset Xj = {Xi)i^i of the variables. These en- 
tropies are not independent — they are subject to a number of 
linear homogeneous inequalities, known as information in- 
equalities, or as the "laws of information theory" Con- 
versely, the set of all such inequalities determines the set of 
possible joint entropies {H{Xi)) up to closure The fun- 
damental inequalities are the monotonicity of the Shannon en- 
tropy, i.e. that the entropy does not decrease if more random 
variables are taken into account, H{Xidj) — H{Xj) > 0, and 
its strong subadditivity, 

H{Xi) + H(Xj) - H(Xinj) - H(Xi^j) > 0. 

These are the inequaUties of Shannon type. Since the seminal 
work 101, it is known that there are entropy inequalities not 
implied by those of Shannon type. In fact, there are infinitely 
many independent such inequalities isj]. 

In quantum mechanics, the state of a quantum state of n par- 
ticles is described by a density operator p on a tensor-product 
Hilbert space. The state of any subset / C {1, . . . , n} of the 
particles is described by the reduced state pj = tr/c p formed 
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by tracing out the Hilbert space of the other particles. The 
natural analogue of the Shannon entropy is the von Neumann 
entropy S{p) = — trplogp i^, and it is of fundamental in- 
terest to determine the linear inequalities satisfied by the en- 
tropies S{pi) of subsystems 10]. The most immediate differ- 
ence to the classical case is that the von Neumann entropy is 
no longer monotonic: global quantum states can exhibit less 
entropy than their reductions (a signature of entanglement). 
Instead, it satisfies weak monotonicity: 

S{piuk) + S(pjuk) - S{pi) - S{pj) > 0. 

Strong subadditivity, however, famously remains valid for 
quantum entropies ||8[|. It is a major open problem in quantum 
information theory to decide whether there are any entropy 
inequalities beyond the above (see [loll for some partial 
progress, including a class of so-called constrained inequal- 
ities). 

Both strong subadditivity and weak monotonicity are tight 
for product states (resp. for independent random variables). 
An entropy inequality J2i '^i^iPi) ^ has that property 
if and only if J2rsi t^i = for all i. Such inequalities are 
called balanced |1 1] and they will play an important role be- 
low. An example of an inequality that is not balanced is given 
by monotonicity. 

Of course, entropy inequalities are also relevant in the case 
of continuous variables (also classically, see e.g. Ill 
as for other kinds of entropies, e.g. Renyi entropies 

In this work we study the entropy inequalities satisfied by 
two classes of quantum states — namely, stabilizer states and 
Gaussian states (which are the continuous-variable counter- 
part of the former). These states are versatile enough to ex- 
hibit intrinsically quantum features (such as multi-particle en- 
tanglement), but possess enough structure to allow for a con- 
cise and computationally efficient description. In both cases, 
quantum phase space methods have been built around them, 
and it is this point of view we aim to exploit here. 

To this end, we consider the Wigner function, which for 
both classes of states is a bona fide probability distribution on 



2 



a classical phase space. For n systems of dimension d, the 
phase space is Z^", while for n bosonic modes it is given 
by R^". In both cases, it is the direct sum of the single- 
particle/single-mode phase spaces. Given a state p, we then 
define a random variable X = {Xi, . . . , X„) on the phase 
space, where Xi denotes the component in the single-particle 
space of the i-th particle or mode. The random variables 
Xi, . . . , Xn constitute our classical model. This construction 
is compatible with reduction: the marginal probability distri- 
bution of a subset of variables Xj = {X.i)i^j is given pre- 
cisely by the Wigner function of the reduced quantum state pj . 
Our crucial observation then is that certain quantum entropies 
are simple functions of the corresponding classical entropies. 
More precisely, we find that 

S2ipi) = H2{Xj)-C\I\, (1) 

where C > is a universal constant and where 52 (p) = 
— logtrp^ and H2{X) = ^logX^K-P^ denote the quantum 
and classical Renyi-2 entropy, respectively. In the case of 
continuous variables, we use the differential Renyi entropy 
H2{X) = -log ^pldx. Therefore, if ^^i//i?2(^/) > 
is a balanced entropy inequality satisfied by the random vari- 
ables Xj then the same inequality is satisfied by the quantum 
state, 

/ / / 

=0 

In the case of stabilizer states all reduced states pi 

are normalized projectors (onto the corresponding code sub- 
space), while the Xi are uniformly distributed (on their sup- 
port). Thus all Renyi entropies agree with each other, and also 
with the Shannon and von Neumann entropy, respectively: 

S{pi) = H{Xi)-\I\. (2) 

As above, it follows that any balanced entropy inequality that 
is valid for the Shannon entropies of the Xi is also valid for 
the von Neumann entropies of the stabilizer states pj. In par- 
ticular, stabilizer states respect all balanced information in- 
equalities, such as the inequalities of non-Shannon type found 
in ifisll . What is more, our construction can also be under- 
stood in the group-theoretical framework of lITil . Here it is 
well-known that there are inequalities which do not hold for 
arbitrary random variables, but only for random variables c on- 
structed from certain classes of subgroups, e.g. normal sub- 
groups ifTsll . Since phase spaces are Abelian groups, it follows 
that the von Neumann entropy of stabilizer states also respect 
such information laws, e.g. the Ingleton inequality ifTsll . which 
is the balanced inequality 

Ipil : J\K) + Ip{I : J\L) + Ip(K : L)~Ip{I : J) > 0. (3) 

Here, : J) = S{pi) + S{pj) - S{piuj) and /p(/ : 

J\K) = S{piuk) + S{pjuk) - S{pk) - S{pijk) are the 
quantum (conditional) mutual information. 

We find it instructive to understand how the above classical 
model manages to respect monotonicity, while the quantum 



state may violate it. For example, since stabilizer states can 
be entangled (even maximally so), H{pi) — H{p2) = 1 and 
H{pi2) = are perfectly valid entropies of a stabilizer state 
which obviously violate monotonicity. Equation (|2]i states that 
the classical model is more highly mixed than the quantum 
one, in the sense that the entropy associated with a subset / is 
higher by an amount of |/|. That is precisely the amount by 
which quantum mechanics can violate monotonicity. 

In the case of Gaussian states (i jllll i. the random variables 
Xi, . . . , X„ have a multivariate normal distribution, and we 
show that the differential Renyi-2 entropy in ^ can replaced 
by the Renyi-a entropy for arbitrary positive a ^ I: 

S2{pi) = H^iXj) - \I\ (^logTT - , 

In the limiting case a 1, we recover a formula involving the 
differential Shannon entropy which has previously appeared 
in ilfitl, attributed to Stratonovich. Thus, Renyi-2 entropies of 
Gaussian states respect all balanced information inequalities 
that hold for multivariate normal distributions (see IUtI [HI). 
Interestingly, it is not clear whether a similar statement holds 
for the von Neumann entropy of the Gaussian state. This 
is perhaps an indication that the connection (|2]l between the 
Shannon and the von Neumann entropy for stabilizer states is 
somewhat coincidental. The comparison with Gaussian states 
suggests that the Renyi-2 entropies might be the more funda- 
mental quantities in this context, that merely happen to agree 
with the von Neumann entropy in the case of stabilizer states. 

We conclude this section with a few remarks. While 
it is known that the Wigner function approach cannot be 
straight-forwardly translated to non-stabilizer states lfl9l - l2lll . 
our discussion suggests searching for other maps from quan- 
tum states to probability distributions that reproduce entropies 
faithfully, up to state-independent additive constants. 

Our note uses the classical model provided by the Wigner 
function as a tool for proving statements that do not, a priori, 
seem to be connected to phase space distributions. This point 
of view has been employed before, e.g. to construct quantum 
expanders ll22ll . to establish simulation algorithms IB3l - l25ll . 
and for demonstrating the onset of contextuality ll26ll . It would 
be interesting to see further applications. 

In order to establish the Ingleton inequality Q, we have in- 
voked the group-theoretical approach to classical information 
inequalities due to lITill . It would be highly desirable to find 
a quantum-mechanical analogue of this work (see ll27[|28ll for 
partial results towards this goal, motivated by the quantum 
marginal problem of quantum physics). 

Convention. In this work, entropies of cZ-level systems are 
measured in units of log d bits. In the continuous-variable 
case, we employ the natural logarithm. 

II. STABILIZER STATES 

In this section, we provide the technical details of our re- 
sults on stabilizer states. The presentation is slightly com- 
plicated by the fact that the phase space methods we employ 
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work somewhat less well in even dimensions than in odd ones. 
The status is as follows: Phase spaces and stabilizer states can 
be defined for any dimension d. Indeed, our main result is 
stated and proved for any d. If the dimension is odd, there 
is an additional piece of structure - namely a discrete Wigner 
function that replicates many properties of its better-known 
continuous- variable variant luOll . For odd d, one obtains the 
classical model that we construct simply by interpreting the 
non-negative discrete Wigner function of a stabilizer code as 
a probability distribution. This observation was the original 
motivation for our general construction. 

We start by fixing some notation and recall the basic for- 
malism of stabilizer states |0,|2^. Our presentation is cen- 
tered on the phase space picture, see ll20ll for a more detailed 
discussion. 

The discrete configuration space of a single particle is Z^, 
where is the set {0, . . . , d — 1} with arithmetic modulo d. 
The associated phase space is = © Wid- We denote the 
components of vectors w e by {p, q) in order to emphasize 
the analogy with momentum and position in the continuous- 
variable theory. A crucial piece of structure is the symplectic 
form defined on the phase space. It maps vectors v = {p, q) 
and v' = {p' , q') to [v, v'] = pq' — qp'. A minor complication 
in even dimensions is that the form must there be understood 
as taking values in Z m, i .e. the arithmetic in pq' — qp' is to 
be taken modulo 2d OQ . Isill . There is a representation of 
in terms of Weyl operators acting on the Hilbert space of 
complex functions on Z^, which we identify with (C^. It is 
given by {w{p, q)4')ix) ~ e^^^^P^^P'^^'i(j{x — q). A straight- 
forward calculation shows that 

w{v)w{v')=e''3^''''''^w{v + v'). (4) 

Thus the Weyl operators realize a projective or twisted rep- 
resentation of the additive group of the phase space (it is a 
faithful representation of the Heisenberg group over H^l)- 

For n particles, the phase space is the direct sum V = 
0"^-^ Vi = Z^" of the single-particle phase spaces Vi = Z^. 
It can be represented on ((C*)®" by the tensor product of the 
single-particle representations, w{v) = {S)"=i w{vi), and the 
composition law (|4]i continuous to hold if we extend the sym- 
plectic form linearly. 

Let us now consider an isotropic subspace M C V, i.e. 
a subspace on which the symplectic inner product vanishes. 
Assume for a moment that d is odd. Isotropicity implies by 
Eq. (01 that the Weyl operators {w{m) \ m G Af} all com- 
mute. Using this fact, one easily verifies that 

defines an orthogonal projection onto a (j"-dimA/_ 
dimensional subspace of ((C*)®". This subspace is called 
the stabilizer code associated with M. The corresponding 
stabilizer state then is the normalized projection 



(One obtains a larger set of stabilizer codes by including cer- 
tain phase factors in the sum in Eq. © iSHIIi. How- 
ever, all stabilizer codes are locally equivalent to one of the 
form (|5]i, so we do not incur a loss of generality). For even 
dimensions, the construction is again slightly more compli- 
cated. Here, one has to choose a basis B = {mi, . . . , nik} of 
M (we have set fc dimM) and define 

^(^) '-^Wl^ w{mir...w{m,r. 

One can then repeat the previous calculation to find that P{B) 
is again a d"~'^'™'*^-dimensional projection. We record that 
in both cases the von Neumann entropy of a stabilizer state is 
given by 

^(^(Af)) =n-dimM. (6) 

Using the basic relation tTw{v) = d"^i,,o, one obtains a 
simple expression for the reduced state p{M)j. For this, let 
Vj :^ {v E V : Vi = for i ^ I}he the phase space of some 
subset of particles / C {!,..., n}, and set Mj := M n Vj. 
Then 

piM)i^piMi), (7) 

i.e. the reduced state is the stabilizer state described by the 
isotropic subspace A// C Vj. From (|6]l we find that 

S{p{M)i) = S{p{Mi)) = \I\ - dim A//. (8) 

We now describe the construction of the classical model for 
odd dimensions. To this end, let us consider the (discrete) 
Wigner function of a quantum state p, which is defined to be 
the function on phase space given by 

Wp{v) = ^ g-if[.,Htr(y;(ti;)tp). 

This definition is in analogy to the continuous-variable case, 
as explained in detail in ll20ll . The central observation is that 
in the case of stabilizer states, the Wigner function M^p(A/) 
formally defines a probability distribution on phase space, i.e. 
it attains only non-negative values and their sum is one. In 
fact, we can easily compute (c.f. ll20l[33ll ) 

bev 

= rf-2»+dimM^^^^(^^ (9) 

where we have defined the symplectic complement by A/^ = 
{v G V : [v,m] ^ Vrn G A/}. Therefore, the Wigner 
function of a stabilizer state with isotropic subspace M <Z V 
is given precisely by the uniform distribution on A/-^ C V. 

Our main observation now is that this construction defines a 
classical model for any given stabilizer state which reproduces 
the entropies of all reduced states up to a certain constant. We 
phrase this result without recourse to Wigner functions in such 
a way that it holds for arbitrary local dimensions, even or odd. 
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Theorem 1. Let V = 0"^i Vi = Z^" be the phase space for 
n particles with local dimension d, where d > 1 is an arbi- 
trary integer. Let p{M) be the stabilizer state corresponding 
to an isotropic subspace M C V, and define a random vari- 
able X = (^1, • • ■ ^Xn) that takes values uniformly in the 
symplectic complement C V. Then, 



S{p{M)j) = H{Xi) - |/|, 



(10) 



and the same conclusion holds if we replace the Shannon and 
von Neumann entropy by any Renyi entropy. 

If d is odd then the above construction can be obtained by 
interpreting the Wigner function Wp^M) '^^ the probability dis- 
tribution of the random variable X. 

Proof To prove ( fTOl l. denote hy ttj : V ^ Vi the projection 
onto the phase space of parties / C {1, . . . , n}. It will be 
convenient to consider Vi as a subspace of V in the natural 
way. To avoid any notational ambiguity, we denote hy X-^' 
the symplectic complement of a subspace X taken within Vj. 
Observe that 

Indeed, if u G M-^ and m/ G Mj, then [7r/(?;),m/] = 
[v, mj] = 0. On the other hand, we find that 

TTiiM-^)-^' C Mi 

To see this, consider a vector vj G Vj and note that if vj _L 
7r/(A/-L) then vi ± M-^, hence vi e M nVi = Mi. We 
conclude that 



7r/(Af-L) = M^'. 



(11) 



Note that Xj ~ tti{X). Since tt/ is a group homomor- 
phism, it follows that Xj is distributed uniformly on its range, 
so that 



H{Xi)^\og\7riiM^)\ = 
= 21/1 - dim Mi 



log|il/^-^^| = dim7\/^^ 
^\I\ + SipiM)j), 



where we have used ([Hi in the last step. We have thus estab- 
lished ([Toll. 

The same result holds if we replace the Shannon and von 
Neumann entropy by Renyi entropies. This is because the sta- 
bilizer states p{M)i are normalized projectors and each ran- 
dom variable Xj is distributed uniformly on its range, so that 
the entropies coincide. 

Finally, it is clear from ([9]l that for odd d the distribution of 
X coincides with the Wigner function Wp(^M) of the stabilizer 
state. It remains to show that the Wigner function Wpj of a 
reduced state pj is obtained by marginalizing the full Wigner 
function (in other words: the quantum and the classical way 
of reducing to subsystems commute): 



Wpiw) 



(12) 



for all V G Vj. While this can easily be proved in full gener- 
ality from the definition of the Wigner function, it is also true 
that for the special case of stabilizer states, Eq. (ITZt follows 
directly from ([TT). □ 




Corollary 2. Stabilizer states satisfy all balanced information 
inequalities. Moreover, they satisfy the Ingleton inequality ([3]). 

Proof. As described in the introduction, the first claim follows 
immediately from ([Tol i. This is because for any balanced in- 
formation inequality J^i '^iH{Xj) > we necessarily have 
that CI 



0. 



Hence the correction term in ([Toi cancels as we sum over all 
subsystems: 



For the second claim, observe that the random variables Xj 
are given as the image of a randomly chosen vector X G A/^ 
along the linear projection ttj : V ^ Vj. Thus a corollary in 
ITsIl shows that the Ingleton inequality ([3]) is satisfied (since 
it is evidently balanced). In the language of ITil [Tsll . this is 
because the entropy vector {H{Xj)) can be characterized by 
normal subgroups (in fact, our phase spaces are even Abelian 
groups). □ 



m. GAUSSIAN STATES 

We sketch the corresponding result for Gaussian states of 
continuous-variable systems. The Wigner function of an n- 
mode Gaussian quantum state p with covariance matrix E and 
first moments p is defined as follows on classical phase space 



Wp{x) 



1 



(27r)"(detS)^ 



-^{x-fi)^S^^{x-tJ.) 



(see e.g. the review 113411 ). Evidently, Wp is the probability 
density of a random vector X ~ {Xi , . . . , X2n ) with multi- 
variate normal distribution of mean p and covariance matrix 
S. Using the well-known relation tr = (Stt)" J Wp (x)dx, 
it follows that the Renyi-2 entropy of the quantum state, 
S2{p) = — logtrp'^, is directly related to the differen- 
tial Renyi-2 entropy of the random variable X, H2{X) ~ 
-log/ W^{x) dx: 



S2{p)^H2{X)-n\og{2n). 



(13) 



The reduced state pi for some subset of modes / C 
{1, . . . , n} is again a Gaussian state, and its covariance matrix 
is equal to the corresponding submatrix of E. Thus the Wigner 
function of pi is given by the marginal probability density of 
the variables Xi = (Xi);^/, and using ([T3] l we find that 



S2{pi)^H2{Xi)-\I\\0g{2Tl). 



(14) 



Equation ( [T4l i states that the Renyi-2 entropy of a Gaussian 
quantum state is always lower than the phase space entropy of 
its classical model, as given by the Wigner function. It is so 
by a precise amount, namely by log(27r) bits per mode. 
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Theorem 3. Let p be a Gaussian state with covariance ma- 
trix S, and define a random variable X = {Xi, . . . ,X„) 
with probability density given by the Wigner fimction Wp{x). 
Then, for any positive a ^ 1, 

S2iPi) = H^Xj) - |/| , 

where Ha{X) = 1/(1 — a) log / Wp{x) dx is the differential 
Renyi-a entropy. In the limit a ^ 1, we recover 

S2ipi)=H{Xi)^\I\{log7r+l). (15) 

where H{X) = ~ J Wp{x) log Wp{x) dx is the differential 
Shannon entropy. 

Proof. It is an easy exercise in Gaussian integration to show 
that the differential Renyi-a entropy of the random variable 
Xj is given by 

H^iXi) = i log det S + |/| (^log 2n - . 

The assertions of the theorem follow from this and (Il4l . □ 

Equation ( fTSb has been previously used in lfl6ll . where the 
formula is attributed to Stratonovich. Just as in the discrete 
case, we immediately get the following corollary; 



Corollary 4. The Renyi-2 entropy for Gaussian states satis- 
fies all balanced information inequalities that are valid for 
multivariate normal distributions. 



Interestingly, Gaussian states can violate the Ingleton in- 
equality (as opposed to stabilizer states, cf. Corollary |2). In- 
deed, this is well-known for multivariate normal distributions, 
and it is readily verified that the counterexample presented in 
ifTsll is a physical covariance matrix of a Gaussian state (i.e., it 
satisfies the uncertainty relation S + ifi > 0, where VL is the 
symplectic matrix). The claim thus follows from Theorem|3] 
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